Federated Learning Under Importance Sampling

نویسندگان

چکیده

Federated learning encapsulates distributed strategies that are managed by a central unit. Since it relies on using selected number of agents at each iteration, and since agent, in turn, taps into its local data, is only natural to study optimal sampling policies for selecting their data federated implementations. Usually, uniform schemes used. However, this work, we examine the effect importance devise non-uniformly guided performance measure. We find involving without replacement, resulting architecture controlled two factors related variability model across agents. illustrate theoretical findings with experiments simulated real show improvement results from proposed strategies.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Importance Sampling for Online Planning under Uncertainty

The partially observable Markov decision process (POMDP) provides a principled general framework for robot planning under uncertainty. Leveraging the idea of Monte Carlo sampling, recent POMDP planning algorithms have scaled up to various challenging robotic tasks, including, e.g., real-time online planning for autonomous vehicles. To further improve online planning performance, this paper pres...

متن کامل

Importance Sampling for Reinforcement Learning with Multiple

This thesis considers three complications that arise from applying reinforcement learning to a real-world application. In the process of using reinforcement learning to build an adaptive electronic market-maker, we find the sparsity of data, the partial observability of the domain, and the multiple objectives of the agent to cause serious problems for existing reinforcement learning algorithms....

متن کامل

Policy Learning by GA using Importance Sampling

The most difficult problem of applying GA to a policy learning is that interactions with the environment require much time to evaluate the individuals. In this paper, we propose a new approach to estimate the individual’s value using importance sampling. Importance sampling reuses the experiences obtained by some policy to estimate values of the other policies. The proposed technique cuts down ...

متن کامل

Importance Sampling

We describe an application of using a change of sampling density to get easier access to rare events during numeric simulations (this is called importance sampling). Our emphasis is on the derivation of the change of density instead of the algorithmic details. We work a small example to make the technique concrete.

متن کامل

Federated Multi-Task Learning

Federated learning poses new statistical and systems challenges in training machinelearning models over distributed networks of devices. In this work, we show thatmulti-task learning is naturally suited to handle the statistical challenges of thissetting, and propose a novel systems-aware optimization method, MOCHA, that isrobust to practical systems issues. Our method and theor...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Signal Processing

سال: 2022

ISSN: ['1053-587X', '1941-0476']

DOI: https://doi.org/10.1109/tsp.2022.3210365